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Abstract. We study the characteristics of weak signal detection by a recurrent 
neuronal network with plastic synaptic coupling. It is shown that in the presence of 
an asynchronous component in synaptic transmission, the network acquires selectivity 
with respect to the frequency of weak periodic stimuli. For non-periodic frequency- 
modulated stimuli, the response is quantified by the mutual information between input 
(signal) and output (network's activity), and is optimized by synaptic depression. 
Introducing correlations in signal structure resulted in the decrease of input-output 
mutual information. Our results suggest that in neural systems with plastic 
connectivity, information is not merely carried passively by the signal; rather, the 
information content of the signal itself might determine the mode of its processing by 
a local neuronal circuit. 
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Information in neuronal circuits is represented by series of action 
potentials that are generated by neurons following the summation of many 
synaptic stimuli. Importantly, the strength of synaptic connection between a 
pair of neurons can be plastically adjusted in a manner that depends on the 
context of network's activity. In addition to the fast response to the action 
potential, synaptic transmission often has another component (asynchronous 
release), that can persist for > 100 msec following strong stimulation of 
the synapse. This constitutes a challenging example of activity-dependent 
noise. Given the fact that neuronal population is often organized in strongly 
connected local recurrent networks, and the wide spectrum of neuronal firing 
frequencies (from 1 Hz to 200 Hz) it is of interest to ask how synaptic 
plasticity, and in particular activity-dependent asynchronous release, affect 
processing of different signals by these local circuits. Understanding the role 
of synaptic plasticity in the detection of weak stimuli can help to unveil the 
principles of information processing in neural systems. 

1. Introduction 

Neurons exchange information with their peers by sending action potentials that are 
transmitted by chemical synapses with activity-dependent strength and are summed 
at the post-synaptic cell body to determine the temporal pattern of spike firing 
The observed rate of neuronal activities spans a wide spectrum, ranging from values as 
low as 1 Hz for spontaneous activity, to values as high as ~ 200 Hz for fast rhythms 
observed in hippocampal regions [2] . Considering that in many cases (for example in the 
CA3 region of hippocampus) neurons are organized in strongly connected local recurrent 
networks (~ 100 neurons) that receive information from more distant parts of the brain 
[3], it is natural to inquire how these local circuits of nonlinear neurons with activity- 
dependent coupling process signals of different rhythmicity. 

The effect of stimulus characteristics on the ability of a coupled neuronal ensemble 
to detect weak signals had been investigated earlier by several researchers using the 
conceptual framework of stochastic resonance (SR) [U G2 [6]. Those studies assumed 
the coupling between the neurons to be static, or at best proportional to the voltage 
gradient. However, neurons usually exchange information via chemical synapses that 
can plastically adjust their strength in an activity-dependent manner on a variety of 
time-scales (from milliseconds to minutes). On the single synapse level, depression 
acts as a low-pass filter, letting through only signals with a typical time scale slower 
than the recovery from depression [7]. In addition, synaptic transmission can often 
be characterized by two components: fast and strong phasic release of transmitter in 
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response to the action potential that invades the synapses, and slow weaker asynchronous 
release (AR) that can persist for > 100 msec following strong stimulation of the synapse 
[H [9j [10] . Since asynchronous release is constrained by the total amount of available 
synaptic resource, this kind of " synaptic noise" is expected to have temporal structure 
that reflects prior activity, therefore constituting an interesting example of activity- 
dependent noise. It is also worth mentioning that memory effects on weak signal 
detection in the stochastic resonance regime were studied earlier for a bistable system 
with internal colored noise [UJ, and it was found that memory (an increase in noise 
correlation time) usually acted to suppress stochastic resonance. 

In the present study, we aim to achieve a somewhat broader goal by asking the 
following question - how would the SR-like response of a plastic system with activity- 
dependent noise depend on the characteristics of an input signal. Different facets of 
this problem have been addressed separately before (see, e.g. P,[12]), but none of these 
earlier studies investigated the consequences of an interaction between signal properties, 
presynaptic plasticity and in particular the effect of asynchronous component of synaptic 
transmission. We show here that when synaptic dynamics are endowed with plasticity 
and competing modes of signal transmission (evoked vs. asynchronous), the recurrent 
network acquires selectivity with regard to the properties of weak stimuli. Such stimulus 
selectivity can be modulated by changing the level of asynchronous release at the model 
network's synapses. Our results suggest that the dynamical control of AR in a local 
circuit (exerted, for example, by glial cells) could act to switch the attention of that 
local circuit to certain stimuli. 

2. Methods 

The neuronal and synaptic models employed here are the same one that were used in our 
previous studies [13], and are based on slight modifications of the model that had been 
developed to study the characteristics of evoked reverberatory responses in cultured 
hippocampal networks [JJJ HO] • 

Network model: Throughout this study, unless otherwise indicated, the system size was 
taken to be N = 100. For each pair (i,j) of model neurons, an uni-directional connection 
was defined with the probability p = 0.1. Self-connections were excluded. In this setup, 
the probability for a neuron to have k incoming contacts is given by binomial formula 



were chosen on the basis of existing evidence from hippocampal cultures [10], to comply 
with the notion of " local circuit" . 

Neuronal model: Information that arrives from synaptic and ionic channels is integrated 
by a neuron to yield a spike-time series. Here, we describe the neuron as a conductance- 
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based one-compartment entity, using a modified version of the Morris-Lecar model 
[j~5| [T6] . This level of modeling represents a compromise between detailed multi- 
compartmental models that encompass realistic dendritic morphologies on one hand, 
and, on the other hand, over-simplified models of the integrate-and-fire variety. The 



ionic current through the neuronal membrane is modeled as - 

lion = gNamooiV - E Na ) + g K w(V){V - E K ) + gi eak {y - E leak ) (1) 

w = O.lS^oo^) - w(V))cosh((V - V 3 )/2V A ) (2) 

moo = 0.5(1 + tanh((V - V^/V*)) (3) 

Woo = 0.5(1 + tanh{{V-V 3 )/V4}) (4) 

With equations [IHJ the dynamics of neuronal membrane potential are described as - 

CV = -I lon (t) + I hg (t) - (V(t) - En^gjYjit) + I signa i(t) (5) 



with the term Y±g~jYj(t) representing summation over all incoming synaptic connections, 
g G [0.5,0.8] mS/cm 2 , and Yj(t) being the (time-dependent) strength of synapse from 
j-th neuron, modeled as described below. We consider a network with excitatory 
coupling, and therefore set synaptic reversal potential to E R = mV. The term I bg 
is a background current that represents the summation of a large number of synaptic 
stimuli from neurons that are not part of the specific local circuit. This current is 
described by the Langevin equation I bg = —Ib g /T n + ^jD/r n Af(0, 1), with r n = 10 msec, 
D = 0.64 • 10~ 2 fi A 2 / cm A , and jV(0, 1) being uncorrelated Gaussian noise with zero 
mean and unitary variance. The term I S i gna i(t) is the weak periodic external signal, of 
amplitude max(l S ignai{t)) = with its frequency v in selected as explained. 

The following parameter values were used: E Na = 50 mV, E K = —100 mV, E ieak = 
-55.8 mV,V 1 = -1.2 mV, V 2 = 23 mV,V 3 = -2 mV,V 4 = 21 mV,g Na = 
10 mS/cm 2 , Qk = 10 mS/cm 2 ,C = 1 fi F/cm 2 . Leak conductance of neuronal 
membrane was set to g\ ea k = 1.5 mS/cm 2 . With this choice of parameters, transition 
from quiescence to a spiking state is accomplished through a Hopf bifurcation. 
Synaptic model: Rather than attempting a complete biophysical description of the 
complex synaptic machinery that would include the quantal nature of vesicular release 
and sensitivity to spatial Calcium profiles, we use a phenomenological model that 
describes the synchronous activation of several active zones [H]. In this "mean-field" 
description, the kinetics of synaptic neurotransmitter resource are given by following 
equations - 

X, = ^ - X 3 (U5{t - t{) + £6{t - ti)) (6) 
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= ~~ + Xj(U6{t - t{) + £6(t - ti)) (7) 
td 

V 7 ■ 

^ = Tt (8) 

c 4 

77(c) = W c4+j ^ 4 (9) 

c = + ilogfyKt - ti) + 1 9 (10) 

Equations loTfTOl describe the response of a j-th model synapse to action potentials that 
occur at times t{. It is assumed that synaptic resource is either in recovered (A), active 
(Y) or inactive (Z) states, and therefore, as is seen from Equations ISTTTOt X + Y + Z = 1. 
The Y — > Z and Z — > X transitions are with rates r^ 1 and r^ 1 correspondingly, sat- 
isfying r^, 1 3> Tft 1 . In addition to fast phasic transmission (the strength of which is 
modeled here as UXj), there are asynchronous synaptic events of amplitude £X,- that 
are generated at times P a . AR event generation (resulting in the t J a ) is treated as a 
Poisson process with a time-dependent rate 77(c), which depends on the synaptic Cal- 
cium concentration, c. The Calcium concentration increases due to action potentials, in 
proportion to the electro-chemical gradient across the synaptic membrane, and decays 
nonlinearly due to active pumping. Note that Eqns r7|9l are coupled with Eq{TU] through 
the spike times t{ and P a . The term I p ensures that in the absence of any presynaptic 
spikes, Calcium is maintained at a non-zero steady-state level. The essentials of the 
synaptic model are summarized in Figure [TJ 

The following parameter values were used to model the properties of synaptic trans- 
mission: td = 5 msec,TR = 0.6 sec,K a = 0.1 fiM,K c = 0.4 fj,M,/3 = 2 fiM/sec, 7 = 
80 nM, c = 2 mM, I p = 0.11 fiM/sec, £ = 10~ 3 . In all simulations, we set U = 0.4. 
Methods of analysis: The output of a neuron is characterized by a sequence {ti} of 
spikes. An equivalent representation is by means of inter-spike-interval (ISI) series, de- 
fined as ISI n = t n+ i —t n ,n > 1. The dynamics of neuronal network is usually visualized 
by means of raster plot, in which each row marks the times of individual neuron firings 
(y axis runs over all the neurons in the network). For signals of fixed frequency z/, n , 
the response of a network is conveniently captured by the coherence of spiking (COS) 
measure [17]. The COS measure, C$, is defined as Cs = Af (°- 9T ^^- L1T ) ; that is, the 
fraction of spikes that are within 20% from the stimulation period, T = . To measure 
the variability of inter-spike interval (ISI) series, we compute its coefficient of variation, 
CV(ISI), defined as CV(ISI) = ^jfjj , where n(ISI) is averaged ISI (inverse of firing 
rate), and a(ISI) is its standard deviation. All results shown are averages over 50 in- 
dependent realizations. 
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Figure 1. Asynchronous release of neuro-transmitter from model synaptic terminals 
facilitates response to weak sub-threshold stimuli. A) Schematic presentation of the 
model for synaptic kinetics used here. B) Response of the model synapse to a repetitive 
series of spikes. Top: post-synaptic response (arbitrary units) for a model without AR 
(solid line), and with AR (dashed line). Asynchronous release acts to reduce synaptic 
response to spikes (inset). Middle: Pre-synaptic calcium trace. Bottom: series of spikes 
that were used to feed into the synapse. C,D,E) Examples of membrane potentials for 
a neuron that is subject to weak sub-threshold periodic stimulation, for the case of an 
isolated neuron (C), coupled to a network with the synchronous release only (D), and 
coupled with both synchronous and asynchronous release components (E). 



3. Results 

3.1. Synaptic depression and asynchronous release optimize the detection of weak 
periodic stimuli 

The goal of our study is to understand how short-term presynaptic plasticity (as 
manifested by synaptic depression) and activity-dependent asynchronous release (AR) of 
neurotransmitter affect the detection and processing of weak signals by a local neuronal 
circuit. To this end, we first investigated the dependence of network activity on the 
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recovery time from presynaptic short-term depression and on the different AR levels, 
for a given pattern of signal. Detection here is monitored by the coherence of output 
spikes with the incoming periodic signal as captured by the COS measure. Results of 
this analysis, shown in Figure [21 suggest that the efficient detection of weak periodic 
stimuli requires matching between synaptic depression and asynchronous release. Fast 
recovery time and high levels of AR increase the firing rate (Figure [2]B, circles) which 
leads to almost zero coherence for high AR rates due to the increased number of spikes 
fired during each signal cycle (FigfJA, circles, and Figl2]E, second panel). On the other 
hand, a very strong depression reduces the firing rate (Figj2]B, triangles) and also reduces 
the ability to fire coherently with the signal (FigfSA, triangles, and Figj2ji)). Note also 
that the case of tr = 1.2 sec is qualitatively different because in this regime of strong 
depression both the detection and the amplification of weak signal are compromised due 
to the low availability of synaptic resource. In between the two extremes of fast and 
slow recovery from depression, and for intermediate levels of AR, there exists a regime 
that yields high levels of spiking coherence. This is best seen from Figj2D, where we 
plot the COS measure as a function of tr, for different levels of AR. Note that low levels 
of AR (Figure [2D, circles) result in a monotonic decrease of coherence as the value of 
tr is increased, i.e. moderate-to-strong expression of asynchronous release is needed to 
create an optimal recovery time. 

3.2. Selectivity with respect to periodic stimuli 

We proceed to investigate the response of a network to properties of the weak periodic 
stimuli. Figure [3] summarizes the dependence of network's response on different periodic 
stimuli. As is seen, for a given set of parameters, the coherence of response to the 
Ui n = 5 Hz stimulus is the lowest one, and actually decreases as the level of AR is 
increased. For intermediate input rate (z/j n = 10 Hz) the COS measure peaks at an 
optimal value of AR, attaining low values for low and high levels of 7] max . For still higher 
input frequencies, coherence of output activity increases monotonically for all values of 
AR under consideration; however, the maximal values of COS measure become smaller 
for higher input rates (diamonds vs. triangles in Figure [3Al). This relative decrease of 
coherence for high stimulation rates is a direct consequence of synaptic depression that 
causes the neuron to skip some cycles. On the other hand, for periodic signals that have 
low input frequency (for example, U{ n = 5 Hz), the "dwell time" (per cycle) near the 
spike generation threshold is increased (as compared with the same-amplitude signal 
of higher frequency). As a result, there can occur an increased number of spikes per 
cycle, and the stronger depression that follows after such an intense period of activity 
acts to reduce the coherence of output activity. This effect for a low-frequency stimulus 
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Figure 2. Efficient detection of weak stimuli depends on the matching between 
asynchronous release and synaptic depression. A) Coherence of spiking plotted vs. rate 
of asynchronous release, for different values of depression recovery time: tr = 0.3 sec 
(circles), tr — 0.6 sec (squares), tr = 0.9 sec (diamonds), tr = 1.2 sec (triangles). B) 
Output rates plotted vs. AR rate, for different values of tr shown in (A). C) Coherence 
of spiking vs. tr, for different values of AR rate: rj max =0.1 (circles), rj max = 0.3 
(squares), 

Vmax — 0-5 (diamonds), and 7] max — 0.7 (triangles). D) Output rates for all 
cases shown in (C). E) Examples of network's collective activity for different values of 
Vmax and tr. From top to bottom: j] max = 0.1, tr = 0.3 sec; r] rnax = 0.4, t r = 0.3 sec; 
Vmax = 0.1, tr = 1.2 sec; r\ m ax = 0.4, tr — 1.2 sec. In all cases (A-D), the signal 
frequency is Vi n = 10 Hz. 

correlates with a high output firing rate (Figure [3j\2), and a high variability of the inter- 
spike- interval series (Figure [3JA.3) . It can also be deduced from raster plots of network 
activity for different levels of AR and different input frequency, shown in Figure 03. 

The observation that signals of different periodicity are differentially processed by 
networks with different levels of asynchronous release suggests that an imposed level 
of AR might constrain a local circuit to optimally detect certain types of stimuli. To 
understand why such an optimization should occur, let us consider the simplest case of 
a single synaptic terminal that is stimulated by pulses at the rate R. To obtain an exact 
expression for the steady state rate of AR, we would need to solve the transcendental 
equation for the synaptic calcium variable: jRlog^) = —I P - It is easy to see that 

the solution c(R) of this equation is a monotonically increasing function of stimulation 
rate, R and at least over some range can be thought of as being linear. The rate 
of AR, 77(c), is also a monotonically increasing function of synaptic residual calcium. 
Hence, the composite function i](c(R)) is itself a monotonically increasing function of 
R, and at least qualitatively can be approximated by the form r] ss (R) oc r] max R if R4 ■ The 
steady state value of the recovered resource variable X (obtained under the conditions 
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X, Y, Z — 0) is X ss = (1 + (UR + C,t](R))(t d + r^)) -1 . Then, the synaptic drive due to 
the asynchronous release at the model synapse is 

Y a (R) <x X ss (R)Vss(R) = (1 + (UR + ^(R))(r D + r R )Y l n max (11) 

In Figure [3)31, the steady state value of recovered resource (dashed line) is plotted 
along the two examples of low and high AR rates. As Figure 032 shows, Y a (R) for 
the two examples shown in Fig. 031 peaks at a certain frequency that is controlled by 
the parameters of synaptic depression. Simulation of a model synapse stimulated by a 
constant rate also confirms that AR peaks at a certain input rate (Fig. [3133). Note that 
if the noise is decoupled from the activity (does not depend on R), no such optimization 
with respect to the input rate is possible. 

Going from the single synapse to the network level, a plot of coherence vs. v in 
(Fig. 0C1) confirms that, for a given level of AR, the COS measure peaks at a certain 
input frequency, v* n . Yet, contrary to what is obtained for a single synapse in EqJTTl 
and in the related numerical calculations (Fig. 033), higher r\ max appear to optimize 
the network for higher v in . Thus, AR works together with feedback interaction between 
neurons to impart the network with stimulus selectivity. The firing rate (Figure 002) 
and its variability (Figure 033) are minimal at the optimal input rate (as compared 
with the responses for other input rates). 

To sum up, in the periodic signal scenario, a neuronal network with plastic synaptic 
connections and activity-dependent asynchronous release of neurotransmitter appears to 
display selectivity with respect to the specific stimulus frequency. The preferred signal 
frequency, that produces maximally coherent output, depends on the maximal rate of 
asynchronous transmission at model synapses. In a sense, then, by modulating the rate 
of AR it is possible to modulate the "attention" of a network to different (periodic) 
stimuli. 

3.3. Response to frequency-modulated signals 

We have argued that a local recurrent circuit with activity-dependent synaptic 
connections and asynchronous release can exhibit selectivity with respect to the 
frequency of a periodic signal. However, real signals very rarely are purely periodic; 
rather, information that is carried by the signal is often encoded as amplitude 
modulation (AM), frequency modulation (FM), or both (AFM) [18]. The case of 
amplitude modulation is quite problematic for a stochastic-resonance-like system, 
because by definition such a system is sensitive to the amplitude of the signal, so a priori 
different components will not be treated equally. On the other hand, adding frequency 
modulation allows for the investigation of complex signal detection while keeping the 
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Figure 3. Network's detection of weak periodic stimulation depends on the stimulus 
frequency. Al) Coherence of spiking vs. rate of asynchronous transmission, for periodic 
stimuli of different rates: v; m — 5 Hz (circles), v; m — 10 Hz (squares), v\ n = 15 Hz 
(diamonds), Vi n — 20 Hz (triangles). The amplitude of stimuli is the same for all cases. 
A2,A3) Averaged output firing rates (A2), and coefficients of inter-spike-interval series 
variation (A3), plotted vs. rate of asynchronous release, for all 4 cases shown in (Al). 
Bl) Schematic presentation for steady state levels of available synaptic resource, X 
(dashed line), and rates of asynchronous release (solid lines), plotted vs. the constant 
stimulation rate, R. B2) Synaptic drive due to asynchronous release, as in (Bl), peaks 
for an optimal stimulation rate. B3) Asynchronous component of synaptic current vs. 
the stimulation rate of model synapse. CI) Coherence of spiking, plotted vs. stimulus 
frequency, for different levels of asynchronous transmission: r] max = 0.3 (circles), 
Vmax — 0.5 (squares), rj max — 0.7 (triangles). C2,C3) Averaged output firing rates 
(C2), and coefficients of ISI series variation (C3), plotted vs. r] max , for all four cases 
shown in (CI). D) Examples of network's collective activity for different levels of AR, 
and subject to periodic stimuli of different frequencies: rj max — 0.3, Vi n = 5 Hz (Dl), 
Vmax = 0.6, v in = 5 Hz (D2), r\ rnax = 0.3, v in = 15 Hz (D3), r\ max = 0.6, v in = 15 Hz 
(D4). For all cases (A-D), t r = 0.6 sec. 



amplitude fixed. To construct a frequency-modulated signal in a controlled way, we 
define signal packets, K iy as 2-periods of constant amplitude but different frequency, Ui 
(Figure 0)3). The frequency is fixed during the packet. The frequency-modulated signal 
is then represented as a series of packets, {K} (FigHJA.). 

Figure H]A. shows that the response of a network to such a composite signal depends 
on the packet's identity (frequency) as well as on the temporal context of its appearance. 
To what extent is it possible to predict the response of a network given stimulation 
by a certain packet? To quantify the ability of an input (packet) to reliably evoke a 
stereotypic response, we computed the mutual information between the input packets, 
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Ki, and the pattern of activity that they evoke in a typical model neuron. Since neurons 
in our model typically fire several action potentials in response to a packet (Figure HJA.), 
we computed, for every appearance of each packet, the averaged inter-spike interval, 
M = {(I SI)}, of neuronal activity during that packet. In so doing, we obtain two 
vectors that characterize the input (vector of packets, K) and the output (vector of 
packets-induced averaged ISIs, M). Mutual information is then computed as- 

w ^ l ?„$; (M ' i0% ' ( «l ) (12) 

where p(K) is the probability to generate a i^-th packet, p(M) is the probability to 
observe averaged ISI that is equal to M, and p(M, K) is the probability to observe av- 
eraged ISI that is equal to M following stimulation by K-th. packet. Since (ISI) (over a 
packet) fluctuates in time, in practice the M values are distributed into 20 bins of equal 
size (each bin is 10 — 15 msec) covering the range from smallest to largest observed ISIs. 

Figure HP shows the dependence of the mutual information measure for the sys- 
tem driven by a composite signal, when Ki e [5, 9, 13, 17)Hz. For r\ max = (no AR) 
I(M,K) attains very low values, suggesting that the background noise h g (t) in itself 
is not sufficient to reliably detect weak stimuli. Yet, increasing levels of asynchronous 
release enhance the detection of stimulus-related information. For high values of AR, 
this constructive effect of the noise is enhanced by stronger synaptic depression (larger 
t r ) (Figures HP, D). In particular, as is the case with the periodic signals, there seems to 
exist an optimal value of the synaptic recovery time at which I(M, K) is maximized. We 
can intuitively understand why such an optimization should occur: in mildly-depressed 
networks, synapses recovery relatively quickly, and therefore the effect of AR is strong, 
leading to low predictability of output based on input. For large t r , the destructive 
effect of depression becomes pronounced [19]. 

Next, we wanted to assess the effects of signal structure on its detectability by 
our recurrent network. First, we compared input-output mutual information for signals 
with different band structure. As Figure HJ5 shows, wide-band composite signals yielded 
higher values of I(M, K) for all levels of AR than did narrow-band signals. Because 
different packets in the wide-band scenario are strongly separated (in terms of their 
frequency), the responses of a network to them are also strongly different. Therefore, 
it is less likely to make an erroneous identification of a packet. This is a nonlinear 
analog of the standard result for linear detection systems that the information rate is 
proportional to the signal bandwidth. In an additional series of tests, we probed the re- 
sponse of a network to correlated stimuli. Correlation was introduced here as a number 
of adjacent periods for packet's presentation to a network. As is seen from Figure HJ 
correlation acted to reduce the mutual information, with the strongest effect exhibited 
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Figure 4. Response to frequency-modulated signals. A) Raster plot of the network's 
activity in response to the frequency- modulated weak stimulus (lower panel). B) 
Examples of elementary packets of different frequencies from which the signal was 
constructed. The packet was defined as 2 periods of a sinusoidal wave. Here, 
Ki = 5 Hz, K 2 = 9 Hz,K 3 = 13 Hz,K A = 17 Hz. C) Mutual information, I(M,K), 
between input frequency packets and averaged ISI during that packet. Open squares: 
tr = 0.6 sec. Closed circles: tr = 0.3 sec. D) Mutual information plotted vs. 
recovery time from depression, for the case r] max = 0.6. E) Mutual information plotted 
vs. the maximal rate of AR, for signal of different band- width (shown in legends). 
F) Mutual information for the case Ki e [5, 9, 13, 17]Hz, for different structural 
scenarios constructed as described in the text. G) Mutual information for the case 
Ki G [14, 15, 16, 17]Hz, for different structural scenarios constructed as described in 
the text. H) Mutual information vs. the number of packet periods (from less structured 
to more structured), plotted for two signals of different composition, for rj max — 0.4. 
For all cases (E-H), tr = 0.6 sec. 



for high-frequency narrow-band signal. 



4. Discussion 

Earlier theoretical studies of synaptic information transfer properties suggested that at 
high input rates the information carried by the synapse should be reduced because of 
the action of short-term presynaptic depression |19j . In this view, depression introduces 
strong fluctuations in the post-synaptic response, and therefore the mutual information 
between input and output (or the ability to reliably predict an output for a given input) 
is reduced. In our recurrent network, reducing the effect of depression (by making the 
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recovery from it faster) resulted in the decrease of mutual information for high levels of 
asynchronous release. This suggests that while asynchronous release can prove beneficial 
for signal detection, in itself it is not sufficient, and relatively strong depression is needed 
in order to reveal the potential contribution of AR to the mutual information between 
input and output. Thus, in the noise-based scenario of signal processing, depression can 
actually play a constructive, rather than destructive, role. 

Frequency selectivity was shown to emerge in feed-forward networks due to the 
opposing action of synaptic depression (that acts as a low-pass filter) and facilitation 
(that acts as a high-pass filter) [20l I2T]. Our findings are consistent with these earlier 
reports, but differ in several points. First, the facilitated AR in our model contributes 
to weak signal detection, thus providing us with the self-consistent framework of signal 
detection and processing. Second, feedback interactions due to network connectivity 
and slow time-scale of AR (that would introduce memory about earlier activation of 
different pathways) are expected to play an important role here. Earlier, we have shown 
that the size of the local circuit and its connectivity rule can play an important role in 
signal detection [13]. It would be interesting to see how AR shapes the function- form 
relation between the type of the signal (function), and the optimal network structure 
(form) to detect that signal. 

Our observations that the coherence of spiking exhibits optimality with respect 
to the stimulus frequency may have broad consequences for signal processing by local 
neuronal circuits, provided that there exists a biophysical mechanism that would allow 
regulation of AR levels at synaptic terminals. One candidate is astrocyte-synapse cross- 
talk. Astrocytes, a sub-type of glial cells, are known to release chemical substances 
(glio-transmitters) that are able to exert regulatory effects on the pre-synaptic side 
by binding to different membrane receptors and activating Ca-associated down-stream 
processes [22]. Notably, a single astrocyte can "touch" O(10 4 ) synaptic terminals, thus 
potentially being able to coordinate the release properties of adjacent synapses [23J. 
Theoretical studies (see, e.g. [211 [25]) have suggested that such astrocyte-synapse cross- 
talk might have important implications for brain function. In particular, in the recent 
study it was shown that feedback from astrocytes can "tune" the synapse to an optimal 
release probability in response to a periodic series of spikes [25J. This optimal point of 
synaptic operation depended on the strength of the astrocyte-induced Calcium signal 
to the synapse. In the present work, the optimal signal frequency (for which the spiking 
coherence is maximal) depends on the level of AR, but the effect of AR is ultimately 
mediated by pre-synaptic Calcium. Thus, insofar as the explicit network-level modeling 
of astrocyte-synapse interaction can be performed, our conclusions could be looked at 
as an extension of more detailed single synapse studies reported in [25J. 
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For higher-frequency narrow-band composite signals, prolonged presentations of 
different packets led to a dramatic fall in the ability of a system to reliably predict the 
pattern of input. This is consistent with the picture in which the action of synaptic 
depression (following long high-frequency stimulation) is to decrease the mutual in- 
formation between input and output (T9]. In a broader perspective, it suggests that 
different internal signal characteristics, such as its bandwidth and temporal structure 
(informational content) can affect its processing by the local neural circuit. In this view, 
information is no longer passively carried by the signal; rather, it actively determines 
the efficiency with which it will be detected by the target. The exact principles by which 
the structure of the information- carrying signals in such a system is constrained to yield 
its optimum are still elusive. 
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